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1. INTRODUCTION 

Mental health disorders in pregnant/breastfeeding women are common problems experienced by 
women globally. The disorders are generally in the form of depression and anxiety related to pregnancy and 
birth [1]. The depression includes depression before birth (antenatal depression) and after birth (postnatal or 
postpartum depression) [2]. Pregnancy or birth anxiety is generally experienced during pregnancy and peaks 
before delivery [3]. Depression and anxiety can trigger the stimulation of uterine contractions that are at risk 
of increasing blood pressure which may cause pre-eclampsia and miscarriage [4], low birth weight (LBW), 
and premature babies [5], [6]. Several studies have stated that depressed mothers pay less attention to their 
own health, do not pay attention to infant immunization, and correlate with the incidence of diarrhea in 
infants [7] and stunting [6], [8]. 

Antenatal services in Indonesia reveal that mental disorders in mothers need initial examination, 
including by posyandu cadres or community health workers [9], community members who are willing, able, 
and have the time to provide posyandu services voluntarily [10]. According to Basic Health Survey 2018, 
10% of pregnant and breastfeeding mothers had got posyandu (integrated services for pregnant and 
breastfeeding mothers provided by cadres) services, and were likely to be served by cadres [11]. Besides 
physical health services, cadres are advised to be able to identify which mothers exhibit symptoms of mental 
disorders [9]. In Aceh, Indonesia, posyandu cadres had received training to identify women with mental 
disorders [12]; however, there is no data showing that posyandu cadres have ever received training to detect 
maternal depression. Research in other countries demonstrates that cadres improve their ability to recognize 
mothers with mental health problems after completing related training [13], [14]. 
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Although posyandu cadres have a significant role in detecting maternal depression, there has been 
no guideline to do it. Posyandu cadres in Indonesia are community members who do not receive special 
education on mental health. They even have diverse educational backgrounds; most are with primary, 
secondary education and only a few have a university educational background. In addition, previous research 
stated that posyandu cadres in Surabaya, Indonesia, have the opportunity to carry out this role [15]. 

This condition indicates the need to provide training for posyandu cadres on how to detect maternal 
depression. Research shows that cadres who have received training on mental health have a better 
understanding and attitude towards mental disorders [16]. Training materials and curricula must be adapted 
to their educational and socio-cultural backgrounds [17], [18]. Therefore, it is necessary to develop 
appropriate training materials and curricula for posyandu cadres in Surabaya to detect mental disorders in 
mothers [19]. Based on the background, this current research aims to obtain themes and constructs that need 
to be incorporated into the training module and curriculum for cadres in detecting mental health disorders in 
pregnant and breastfeeding mothers. 


2. RESEARCH METHOD 

This current research is exploratory research using the Delphi technique carried out in three stages, 
namely i) reference search, ii) survey from a panel of experts, and iii) consensus determination. The first 
stage aims to compile the themes and constructs of the training for detecting mental disorders in pregnant and 
breastfeeding women from academic and non-academic references. The academic references were obtained 
from Indonesian and international journals, using the keywords “training to detect postpartum depression”, 
“training to detect mental disorders in postpartum mothers”, and “training to assess mental health problems in 
postpartum”. Non-academic references were obtained through the Google data search engine, with the 
following criteria: i) information presented by mental health experts and maternal-child health experts, 
ii) presented by the institutional websites, not individuals. The google searches were conducted using the 
same keywords as academic searches. The research team extracted the data from references to find a list of 
themes and constructs of training. The list was then compiled into a survey to be submitted to an expert panel 
to obtain consensus (agreement). 

The second stage assessed the themes and constructs recorded, which were then compiled into a 
Likert Scale questionnaire and given to an expert panel for assessment. The experts were also allowed to 
provide recommendations for statements in each group of themes. The expert panel involved at this stage 
consists of 3 groups of experts: i) academicians, ii) practitioners, and iii) the public, with the following 
criteria: i) a group of academic experts: a) experts in mental health and/or maternal and child health with a 
minimum educational background of master level, b) living in Surabaya, and c) willing to fill out a survey; ii) 
The group of practitioners: a) having practical experience in mental health and/or maternal and child health, 
b) having been/is currently practicing in primary health care called puskesmas in Surabaya; and iii) public 
groups: a) having been/is currently a posyandu cadre, b) being able to read and write, and c) living in 
Surabaya. 

The expert panel agreement is based on a percentage of the voter turnout, with three categories of 
determination: “accepted”, “considered”, and “rejected”. Statements that are “accepted”? are those that get 
“Strongly Agree” and “Agree" by at least 75% of the participants. Statements that are “rejected” are those 
that get “Disagree” and “Strongly Disagree” by at least 75% of the participants. Statements outside these 
criteria are classified as “considered” and are revised according to the experts’ recommendations. The revised 
statements, along with those “rejected”, are given back to the panel for Stage 3. The third stage assessed the 
“rejected” and “considered” themes and constructs which have been revised in accordance with the experts’ 
suggestions. The agreement is based on the assessment carried out in Stage 2. This research has received a 
research ethics certificate issued by the Research Ethics Commission of the Faculty of Nursing, Universitas 
Airlangga No: 2085-KEPK. 


3. RESULTS AND DISCUSSION 
3.1. Stage 1 reference search 

Stage 1 obtained ten academic references and ten non-academic references related to training to 
detect mental disorders in mothers after childbirth. After elimination, four academic references [20]-[23] and 
eight non-academic references [24]-[31] that met the criteria were selected. Several sources were eliminated 
because they did not meet the criteria (e.g., not discussing the training in detail, there was no clear 
explanation of the training because it was only intended as an experimental treatment, and mental disorders 
detected were not in accordance with the research objectives). The results of the extraction of the references 
include the following themes: i) training time, ii) training materials, iii) training delivery methods, iv) 
training objectives, v) evaluation methods, vi) training duration, and vii) trainer qualification. The seven 
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themes (referred to as ‘aspects’) were then compiled into a 31-item Likert scale questionnaire to be assessed 
by a panel of experts. Extraction themes of postpartum depression training for cadres as shown in Table 1. 


Table 1. Extraction themes of postpartum depression training for cadres 
Aspect Item References 
Training objectives — Providing basic knowledge about postpartum [20], [24] 
depression 
— Improving the basic ability of cadres to detect 
mental disorders in postpartum mothers. 
Training materials — Definition, causes, criteria, and incidence of mental [20], [21], [24], [29] 
disorders in postpartum mothers 
— Early symptoms of depression in postpartum 
mothers and postpartum depression screening tools. 
— Early intervention for postpartum depression 
(psychological first aid) 
Training method — Roleplay among participants [20], [21], [241-129] 
— Lecturing followed by group discussion 
— Using the training module 
— Using educational websites that contain videos, 
materials, and quizzes 
— Online training (workshop or webinars) 
— Using interactive videos 


Training time — 3 times a week [20], [25], [28] 
— 3 weeks (once a week) 
— Aday 
— 2days 

Training duration — 1.5 hours for each training session [31] 


— 2 hours for each training session 
— 1 hours for each training session 
— 3 hours for each training session 
— 4 hours for each training session 
Training evaluation — Pre-test and post-test [20], [22], [28], [30] 
method — Interactive quiz 
— Practice roleplay 
— Discussion and Q&A 
Trainer qualification — Psychologist [23], [31] 
— Psychiatrist 
— General practitioner 
— Midwife 
— Nurse 
— Cadre 
— Survivors 


3.2. Stage 2 expert agreement 

In Stage 2, the questionnaire was given to a panel of experts to get a consensus. The expert 
agreement process was carried out in 2 rounds. The first round obtained answers from 36 participants with 
the following details: cadres (n=3), Family Welfare Movement’s (called PKK an abbreviation of Pembinaan 
Kesejahteraan Keluarga, a social development movement that operates at all civil administration level 
including village) administrators (n=2), psychologists (n=12), Midwives (n=16), Doctors/General 
Practitioners (n=1), and 2 participants in other professions. The first round tested 31 items from 7 aspects. In 
this round, the expert panel agreed on 21 items of the six aspects, including training objectives, training 
materials, training delivery methods, evaluation methods, and trainer qualifications. Two other aspects had 
not received consensus (i.e., the duration and time of the training) and were retested in the second round 
along with two items from the trainer qualification aspect based on the panel’s feedback. 

In the second round, only 14 of the 36-panel members (n=14) gave their assessment, consisting of 
midwives, psychologists, and posyandu cadres. The second round tested ten items with the following results: 
five items were accepted and the other five items were rejected. The expert panel agreed that the cadres are 
not qualified to become trainers, the duration of the training should be 1.5-2 hours and the training time 
should be three times a week or once a week for three weeks. The Stage 2 process is presented in Figure 1. 


3.3. Stage 3 Summarizing the panel experts’ consensus 


The results reveal the appropriate themes and constructs of training for improving the cadres’ 
knowledge of maternal depression and increasing their ability to identify maternal depression. However, the 
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panel suggested using more neutral terminology such as “postpartum depression” [32], [33] to replace the 
phrase “mental disorder.” The panel also provided additional recommendations on the training objectives, 
namely to reduce the likelihood of the baby blues symptoms occurring in mothers. Table 2 presents the items 
agreed upon by the expert panel. 


Considered 
(n= 10) 


Accepted 
(n=21) 


Rejected 
(n=0) 


Accepted Rejected 
(n=5) (n= 5) 


Included Items 
(n= 26) 


Accepted Rejected 
(n= 26) (n= 5) 


Figure 1. The Delphi processes 


Table 2. Expert consensus of postpartum depression training program for cadres 
Aspect Item 
Training objectives — Providing basic knowledge about postpartum depression 
— Improving the basic ability of cadres to detect mental disorders in 
postpartum mothers 
Training materials — Definition, causes, criteria, and incidence of mental disorders in 
postpartum mothers 
— Sharing session from those who have experienced postpartum 
depression 
— Early symptoms of depression in postpartum mothers and 
postpartum depression screening tools 
— Early intervention for postpartum depression (psychological first aid) 
Training method — Roleplay among participants 
— Lecturing followed by group discussion 
— Using the training module 
— Using educational websites that contain videos, materials, and 
quizzes 
— Online training (workshop or webinars) 
— Using interactive videos 


Training time — 3 times a week 
— 3 weeks (once a week) 
Training duration — 1.5 hours for each training session 
— 2hours for each training session 
Training evaluation method — Pre-test and post-test 


— Interactive quiz 

— Practice roleplay 

— Discussion and Q&A 
Trainer qualification — Psychologist 

— Psychiatrist 

— General practitioner 

— Midwife 

— Nurse 

— Survivors 
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3.4. Discussion 

Regarding the training materials, the panel approved the following materials: i) definitions, causes, 
criteria, Regarding the training materials, the panel approved the following materials: i) definitions, causes, 
criteria, and prevalence of maternal depression in postpartum mothers; ii) sharing sessions from people who 
have experienced postpartum depression; iii) early symptoms and postpartum depression screening tool; iv) 
knowledge about early intervention for postpartum depression (psychological first aid (PFA)) and practice; 
and v) prevention of postpartum depression. Various studies stated that the definition and scope became 
imperative in mental health training because it was the first way to recognize symptoms, especially related to 
detection [34]-[38]. Activities such as the PFA and mental health first aid (MHFA) are presented at the 
beginning [37], [39]-[41]. Sharing sessions is also essential to build knowledge about a topic or problem 
[17], [42]-[44]. 

The agreed training methods are lecturing followed by group discussion, role play, and utilization of 
interactive video media, quizzes, modules, and websites. These methods have been widely applied to train 
the community [17], [43], including to train the health cadres in India, similar to those in Indonesia [45]. 
Giving structured tasks is another option with solid, precise, clear, and interesting material delivery. The 
online training method has not yet received agreement from most experts because of technological challenges 
such as connectivity, low internet speed, lack of knowledge in using smartphones, and limited internet data 
[46]. 

For training time and duration, the expert panel agreed that the training duration should be 
1.5-2 hours per session, three times a week or once a week for three weeks, and should be held from 
10 to 12 a.m. [47]. The training time is not carried out all day long but is repeated sequentially, for example, 
on two consecutive days with assignments between breaks. The time and duration of activities are a concern 
in various training for lay health workers [17], [45]. Evaluation needs to do to help participants remember the 
material [37]. Evaluation can be pretest-posttest, interactive quizzes, role-play practices, discussion, and 
question-and-answer activities. The panel also suggested that the evaluation results should be submitted 
immediately after the assessment to increase the motivation of the training participants to follow the next 
stage. As for trainer qualifications, consensus states that trainers should be psychologists, psychiatrists, 
survivors, nurses, general practitioners, or midwives. Posyandu cadres, however, are not recommended to 
become trainers. The panel emphasized the need to pay attention to the capacity and experience of trainers 
based on the appropriate profession and, more importantly, those of practitioners and academicians [19], 
[31]. The results of this study reinforce the need to carefully develop a curriculum for volunteers in the 
community so that it is right on target [19]. Although participatory methods are not applied, the Delphi 
Technique gives an opportunity to gather available knowledge and practical experience. The technique provides 
benefits in gathering information widely from people who may be hesitant to speak out in front of others such as 
in focus group or other traditional forums [48], and the case which could also happen to women [49]. 


3.5. Limitations 

This study has limitations on the equivalence of the number of expert panel participants in each 
category. Although the number of panels and variations are representative enough, the composition in each 
type of expertise is not equal. The non-academic references were gathered from Indonesia context to ensure 
the similarity with the research objective. Nevertheless, the number of those were quite small, may be due to 
programs of maternal mental health in this country is also limited. 


4. CONCLUSION 

The result of this current research provides indispensable information about the themes and 
technical preparations needed to develop materials and curricula for detecting maternal mental health 
problems. The panel of experts agreed on the objectives of the activity, the material to be delivered, the 
method of implementation, the duration of the activity, the evaluation of the activity, and the trainers. The 
findings of this study can be the basis for developing modules and curricula to detect postpartum depression 
in pregnant and breastfeeding women for cadres in Surabaya in particular and Indonesia in general. 
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